Statistical mechanics of scale-free networks at a critical point: 
Complexity without irreversibility? 
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Based on a rigorous extension of classical statistical mechanics to networks, we study a specific 
microscopic network Hamiltonian. The form of this Hamiltonian is derived from the assumption 
that individual nodes increase/decrease their utility by linking to nodes with a higher/lower degree 
than their own. We interpret utility as an equivalent to energy in physical systems and discuss the 
temperature dependence of the emerging networks. We observe the existence of a critical tempera- 
ture T c where total energy (utility) and network-architecture undergo radical changes. Along this 
topological transition we obtain scale-free networks with complex hierarchical topology. In contrast 
to models for scale-free networks introduced so far, the scale-free nature emerges within equilibrium, 
with a clearly defined microcanonical ensemble and the principle of detailed balance strictly fulfilled. 
This provides clear evidence that 'complex' networks may arise without irreversibility. The results 
presented here should find a wide variety of applications in socio-economic statistical systems. 
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Triggered by the vast number of observed non-trivial 
networks in nature, recently a respectable number of 
models have been introduced to understand their sta- 
tistical properties. Since many of these networks differ 
considerably from pure random graphs the notion 
of complex networks has emerged which is a well estab- 
lished concept nowadays 0, U- Perhaps the most ap- 
parent property distinguishing such 'complex' real-world 
networks from pure random graphs is their scale-free de- 
gree distribution P{k) ~ k which seems to be ubiq- 
uitous in nature Further, many real- world networks 
exhibit a high amount of clustering, and sometimes even 
a non-trivial dependence of the clustering coefficient, Ci 
of node i, when seen as a function of its degree hi. A 
power form of (C(fc)) ~ k~ 6 can be associated to the 
'complex' topological property of hierarchical clustering 
0. Allmost all of the microscopic models proposed to 
describe such 'complex', growing or static, networks in- 
volve non-equilibrium and evolutionary elements, mani- 
festing themselves in different procedures of preferential 
attachment JM El El ||| or other structured rewirement 
schemes 0, 0, Further, these procedures often in- 
volve the need for non-local information. The reasoning 
behind these approaches has further solidified the notion 
of complex networks. The concept of non-equilibrium in 
the context of networks is so dominant, that recently even 
structured rewirement schemes have entered the very def- 
inition of network-ensembles 0, 0] . Less drastic views 
of ensembles of networks have recently been used to gen- 
eralize random graphs to networks with arbitrary degree 
|l3| , and to generate scale- free networks by appropriately 
tuning the weights of 'network- Feynman graphs' 

So far, comparatively little has been done to under- 
stand complex networks from a purely classical statistical 
mechanics point of view, fully satisfying its foundations 



such as equal a-priori probabilities. Aiming at an expla- 
nation of scale-free networks based on microscopic inter- 
actions, several serious equilibrium approaches have been 
proposed 0, 0, 0|. In particular topological prop- 
erties of networks associated with specific Hamiltonians 
have been studied [lfl Il7j . The Hamiltonians investi- 
gated there lead to interesting dynamics, but - to our 
knowledge - not to scale- free, complex networks. 

The aim of this paper is to close this fundamental 
gap by proposing a Hamiltonian leading to scale-free, 
hierarchic networks in thermal equilibrium. The form 
of the Hamiltonian is derived from simple, general, and 
socio-economically motivated assumptions about individ- 
ual utilities of nodes. Nodes act as utility maximiz- 
ers, such as physical particles minimize energy. For the 
greater ease of the exposition of our model we shall use 
the notions of utility and inverse energy interchangeably. 

We consider symmetric networks with a fixed num- 
ber of distinguishable nodes i = 1,...,N, connected by 
a fixed number of £ = l,...,L indistinguishable links. 
The network is represented by its adjacency matrix c, 
where 



cji = 1, if a link connects nodes i and j 
= C 

canonical partition function as 



and Cij — Cji = 0, otherwise. Thus, we define the micro- 



il(E, N,L) = J2 Ji S ( E - nc))5(L Tr(^)) , 

P(c) 



(1) 



with H(c) being the network Hamiltonian and P(c) de- 
noting all permutations of the N x N adjacency-matrix. 
This definition guarantees that each possible configura- 
tion of the adjacency matrix is realized with the same a 
priori probability. The canonical partition function may 
be obtained by the Laplace transform of Eq. |fjQ), [J^, or 
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FIG. 1: Node-utility as a function of Afc = ki — 
values of b. The parameters in Eq. @ are ax = 1, c\ 
a,2 = 0.5 and C2 = 1.5. 



for different FIG. 2: Ensemble average of normalized internal energy 
10, U(T) = U(T)/min(U(T)) and specific heat C{T) (inset) as 
a function of T, for TV = 10 3 ,6 = 5 and various densities p. 



via the maximum entropy principle, as shown in [lfj, 
Z(T,N,L) = J2 6 ( L -^^-) e ~ mC) > ( 2 ) 

P(c) V / 

using the usual definition of temperature T = ^W. In 
simulations the canonical ensemble can be generated e.g. 
by the Metropolis-algorithm: starting from an adjacency 
matrix c, a 'virtual' graph c is generated by a random 
rewirement step. Then, c is accepted with probability 
Pacccpt = min(l,exp[-/?(W(c) -H(c))}). 

Given Eq. (J2J one may study any reasonable Hamilto- 
nian depending on any properties of the network. Here, 
we want to adopt the view of modeling microscopic inter- 
actions, where the total energy of a network can be ex- 
pressed as the sum over all energy /utility contributions 
of individual nodes, «j. In many realistic settings this 
node-utility will depend on properties/states of node i 
itself, and on properties of the node j whereto a link is 
established. These node-properties are denoted by TI(z) . 
In this case the Hamiltonian is also expressible as a sum 
over all links, 

L 

w(c) = 5><Cn(«),n(i)) , (3) 

where ut(H(i),H(j)) is the utility of link I connect- 
ing nodes i and j, who are characterized by their 
properties TI(z) and H(j), respectively. For simplicity 
we assume linearity and separate ui into the individ- 
ual node-contributions ue(H(i), II(j)) = m(Il(i) 7 II(j)) + 
Wj(II(i), n(j)). In the following we specify the model 
such that the utility of a node increases if it connects 
to a node that is 'more important' than itself. Simi- 
larly, its utility decreases if it establishes a (potentially 
costly) link to a 'less important' node. As a simple mea- 
sure for importance we suggest the degree of a node, i.e. 



IT(i) = ki. The relative importance between two nodes 
is denoted by Afc = \ki — kj\, which will enter the utility 
function as the only argument. For the particular form of 
the utility function we chose a standard, monotonically 
increasing, concave log-utility function |l9| . which incor- 
porates the concept of decreasing marginal utility [lflj . 
We thus model node-utility by 

f ci + ai log(6i + Afc) for fc, > kj 

\ c 2 — a 2 log(6 2 + Afc) for ki < k 3 W 

with shape parameters a and b, and offsets c. To avoid 
discontinuity in the utility function we set c 2 = c\ + 
ai log (&i) + a2 log (62). This function is shown in Fig. ^ 
For the sake of further simplicity, we assume b\ = 62 = b, 
to obtain a particularly simple form for the link-utility, 

ue(ki,kj) = ci + c 2 + (a-L-a,2)log(b + Ak) . (5) 

Parameter c\ can be chosen to ensure positive total util- 
ity for each link. Parameter b controlls the curvature of 
the utility function 0, and will be called 'sensitivity 
parameter' in the following. 

Equation (J5J can be interpreted as the inverse energy 
of each link which allows us to perform simulations of 
the associated canonical ensemble, Eq. 0. The (col- 
lective) amount of 'irrationality' of individual nodes, i.e. 
that nodes do not fully maximize their utility (by error 
or ignorance) is captured by the 'temperature' T . For 
o>x = C12, the utility is independent of Afc and we ob- 
tain random networks, as expected. For a\ ^ a 2 , the 
constants a and c can be absorbed in the temperature 
scale (Boltzmann constant) of the system; hence they 
are omitted without loss of generality. We assume that 
ai > a,2, meaning that the concave utility-contribution of 
the node of lower degree is more dominant than the con- 
vex utility-contribution from the node of larger degree, 
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FIG. 3: Degree distributions at different temperatures for 
N = 10 3 , p = 3, and b = 5. The line for T = 5 is the 
Poissonian p(k) = e ^ p . 



(putting more emphasis on wins than on losses) leading 
to an asymmetry in utility, Fig. ^ We finally base our 
simulations on the Hamiltonian, 



W(c) = -^log(6 + Afe) 



(6) 



Based on Eq. (0 we simulate networks of the canonical 
ensemble, Eq. ranging from N = 500 to 10 4 nodes. 
For computational reasons, temperature-dependent re- 
sults are presented for TV = I0 3 . All ensemble- averages 
have been calculated from at least 2 x 10 3 configurations, 
separated by at least 20 x N update steps. We analyze the 
obtained networks as a function of the model parameters 
- temperature (irrationality) T, link density p = 2L/N 
and the 'sensitivity' parameter b. 

Figure [21 shows the ensemble average of the total en- 
ergy of the system as a function of T for different val- 
ues of p. For better comparison data has been normal- 
ized to the minimum energy. Also shown is the specific 
heat C, obtained by a numeric derivative of the energy- 
data. One clearly finds a radical change in the energy and 
a characteristic maximum of the specific heat at about 
T c = 0.8 — 0.85, indicating the presence of a critical point. 
The transition softens for higher link-densities, as well as 
for lower values of b (not shown). We refrain from com- 
menting on the size of the underlying critical exponents, 
whose proper extraction is beyond the scope of this work. 

The change in energy is associated with considerable 
restructuring of the underlying networks. To discuss this 
in more detail we have calculated ensemble-averages of 
degree distributions for various points along the transi- 
tion. The results are shown in Fig. [3] for N — 10 3 , p = 3 
and 6=5. For temperatures up to about T ~ 0.5, we 




FIG. 4: (a) Finite size dependence of the degree distribution 
for various JV and b (inset) and p = 3. For b = 5, we have 
T — 0.95, being somewhat higher for 6 = 1. (b) Degree 
distribution for different link-densities p, N = 10 3 , and 6 = 5. 
Temperatures are adjusted to the pure scale-free region. 



observe networks with degrees of all magnitudes. From 
T ~ 0.5 upward, a core of highly connected nodes (bump) 
keeps growing, gradually shifting to the left. For T < 0.8, 
the two regions in the degree distribution coexist. In the 
interval 0.8 < T < 0.95, the highly connected core merges 
with the rest of the network and gradually disappears 
with further temperature increase. At T ~ 0.95 a pure 
power-law P(k) ~ k" 1 with exponent 7^3 matches the 
degree distribution. Ignoring the bump at higher degrees, 
the degree distribution may also be approximated reli- 
ably for lower temperatures (down to about T ~ 0.80). 
In the T interval [0.80, 0.95] the degree exponent covers a 
range of 7 € [5.5,3], respectively. Increasing the temper- 
ature above T = 0.95, keeps the power-law exponent 7 
practically unchanged, but shifts the exponential cutoff 
to the left, ultimately leading to random networks with 
Poissonian distributions, Fig. |3 

Finite-size effects and the role of parameter 6 for the 
scale-free region are captured in Fig. 0]a. Sizes N = 10 3 
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FIG. 5: Degree-dependence of the average cluster coefficient 
(C(fe)) at different temperatures. N = I0 3 , p = 3 and b = 5. 



ducted earlier 0, ; n0 modifications of the sampling 
of phase-space are used (clearly defined microcanonical 
ensemble) such that the full power of equilibrium sta- 
tistical mechanics is retained. We have obtained the 
first reversible, equilibrium access to scale-free networks 
based on microscopic interactions satisfying detailed bal- 
ance. Preferential attachment and structured rewirement 
schemes model many non-equilibrium processes in the 
real world adequately, however, it has to be noted that 
scale-free networks also exist within a pure equilibrium 
concept. Finally, as the notion of complexity is usually 
tightly connected to dissipative structures far from equi- 
librium, our results could stimulate a discussion about 
the actual complexity of 'complex' networks. 
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Farmer for their great hospitality and support in Sept- 
Oct of 2004. The project was supported by the Austrian 
Science Foundation FWF under P17621 G05. 



and N = 8 x 10 3 are compared for b — 1 and 6 = 5; both 
exhibit nice scaling. Power-law fits yield a degree expo- 
nent of 7 ~ 3 and 2.5 for b = 5 and 6=1, respectively, 
regardless of system size. Variation of 6 therefor allows 
to model virtually all exponents occurring in real-world 
networks Q. 

In Fig. El we show the degree-dependence of ensem- 
ble averages of the mean cluster coefficient (Ci)i = 
(2rii/ki(ki — where rn is the number of links between 
the neighbors of node i, [i(J. For T — 0.85 we obtain 
a nice scaling-law (C(fc)} = k 5 , with 5 = — 1. This is 
in very good agreement with many empirically examined 
data [4| and demonstrates that our model reproduces the 
'complex' topological property of hierarchical clustering 
found in many socio-economical networks. For higher 
temperatures, 5 stays the same, however, the onset of 
the cutoff regime changes, resulting in a flat curve for 
high temperatures (not shown). 

The results presented hold qualitatively for relatively 
small p. For p larger than 5, a characteristic scale grad- 
ually emerges, due to the fact that the mean (k), cor- 
responding to high-temperature random networks, shifts 
to larger values. Despite this characteristic scale, for ap- 
propriate temperatures, a power-law may still be fitted 
to a region, Fig. ^ b. Here temperatures are chosen 
such that the pure scale-free region is recovered (with- 
out the bump). The characteristic exponent of 7 = 3 is 
preserved. 

In summary, in the course of a very general model of 
socio-economical systems, where individuals are utility 
maximizers with bounded rationality, we discovered that 
scale-free networks with hierarchical clustering naturally 
emerge in the vicinity of a critical point. Most remark- 
ably, the mechanism behind these results is nothing but 
the theory of equilibrium statistical mechanics, rigorously 
applied to networks. In substantial contrast to work con- 



* E-mail: christoly.biely@meduniwien.ac.at 
t E-mail: thurner@univie.ac .atl 
[1] P. Erdos, A. Renyi, Publ. Math. Debrecen 6, 290 (1959); 

Publ. Math. Inst. Hung. Acad. Sci. 5, 17 (1960). 
[2] A.-L. Barabasi, Rev. Mod. Phys. 74, 47 (2002). 
[3] S. Dorogovtsev, J.F.F. Mendes, Evolution of Networks: 

From Biological Nets to the Internet and WWW, (Oxford 

University Press, 2003). 
[4] E. Ravasz, A.-L. Barabasi, Phys. Rev. E 67, 026112 

(2003). 

[5] A.-L. Barabasi, R. Albert, Science 286, 509 (1999). 

[6] M. Rosvall, K. Sneppen, Phys. Rev. Lett. 91, 178701 

(2003) . 

[7] J.J. Ramasco, S.N. Dorogovtsev and R. Pastor-Satorras, 

Phys. Rev. E 70, 036106 (2004). 
[8] G. Caldarelli, A. Capocci, P. De Los Rios and M.A. 

Munoz, Phys. Rev. Lett. 89, 25 (2002). 
[9] M. Baiesi, S.S. Manna, Phys. Rev. E 68, 047103 (2003). 
[10] B.J. Kim, A. Trusina, P. Minnhagen and K. Sneppen, 

Eur. Phy. J. B 43, 369 (2005). 

[11] S. Thurner, C. Tsallis, cond-mat/0506140 

[12] S.N. Dorogovtsev, J.F.F. Mendes and A.N. Samukhin, 

Nucl. Phys. B 666, 396 (2 003). 

[13] S. Abe, S. Thurner, cond-mat/0501429 

[14] Z. Burda, J.D. Correia and A. Krzywicki, Phys. Rev. E 

64, 046118 (2001). 
[15] J. Berg, M. Lassig, Phys. Rev. Lett. 89, 228701 (2002). 
[16] J. Park, M.E.J. Newman, Phys. Rev. E 70, 066117 

(2004) . 

[17] I. Farkas, I. Derenyi, G. Palla and T. Vicsek, Lect. Notes 
Phys. 650, 163 (2004); G. Palla, I. Derenyi, I. Farkas and 
T. Vicsek, Phys. Rev. E 69, 046117 (2004). 

[18] W.T. Grandy, Foundations of Statistical Mechanics, 
(Kluwer Academic Publishers, 1987). 

[19] J.E. Ingersoll, Theory of Financial Decision Making, 
(Rowman & Littlefield Publishers, 1987). 

[20] Numerical ensemble averages may lead to artifacts if 
(C(fc)), in network realizations where the respective de- 
gree k is not existing, are defined as (C'(k)) — 0. 



